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(54) Image encoding and decoding method 



(57) Innage encoding apparatus 1 0 according to the 
present invention is an image encoding apparatus 10 
for dividing Image signals into blocl<s, performing an or- 
thogonal transform of each block, reading resultant or- 
thogonal transform coefficients to obtain a coefficient 
string, and performing entropy coding, which has block 
selector 1 4 for selecting a size of a block for the orthog- 
onal transform, out of a plurality of blocks of different 
sizes; coefficient string divider 1 2 for, when a block of a 



size largerthan a minimum size is selected by block se- 
lector 14, dividing a coefficient string in the block into a 
plurality of coefficient strings of a length equal to that of 
a coefficient string in a block of the minimum size; and 
encoder 1 3 for performing entropy coding adapted to the 
coefficient string in the block of the minimum size. This 
substantializes the Image encoding apparatus capable 
of achieving efficient entropy coding in the orthogonal 
transform of variable sizes. 
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Description 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[0001] The present invention relates to an image en- 
coding method, an image decoding method, an image 
encoding apparatus, an image decoding apparatus, an 
Image processing system, an image encoding program, 
and an image decoding program capable of implement- 
ing efficient entropy coding of orthogonal transform co- 
efficients in an orthogonal transform permitting selection 
among multiple block sizes. 

Related Background Art 

[0002] Encoding techniques of image signals are 
used for transmission and for accumulation and repro- 
duction of image signals of still images, moving images, 
and so on. Such techniques include known international 
standard encoding methods, e.g., ISO/IEC International 
Standard 1 091 8 (hereinafter referred to as JPEG) as an 
encoding technique for still images, and ISO/IEC inter- 
national Standard 14496-2 (MPEG-4 Visual, which will 
be referred to hereinafter as MPEG-4) as an encoding 
technique for moving images. A newer known encoding 
method is ITU-T Recommendation H.264; ISO/IEC In- 
ternational Standard 14496-10 (Joint Final Committee 
Draft of Joint Video Specification, ftp//ftp. imtc-files.org/ 
jvt-experts/2002 07 Klagenfurt/JVT-D1 57.zip, which will 
be referred to hereinafter as H.26L), which is a video 
coding method intended for joint international standard- 
ization by ITU-T and ISO/IEC. 

[0003] Image signals demonstrate close correlations 
between spatially neighboring pixels and thus transfor- 
mation into the frequency domain leads to deviation of 
information to the low frequency region, which enables 
reduction of redundancy by making use of the deviation. 
Therefore, the typical image encoding methods adopt a 
technique of subjecting image signals to an orthogonal 
transform to transform them into orthogonal transfonn 
coefficients in the frequency domain, so as to achieve 
deviation of signal components to the low frequency re- 
gion. Furthennore, the coefficient values are quantized 
so that small-valued coefficients are converted into ze- 
ros. A coefficient string is made by reading the coeffi- 
cients in order from the lowest in the low frequency re- 
gion and is subjected to entropy coding taking advan- 
tage of the deviation of coefficient values, thus achieving 
efficient encoding with reduction of redundancy. 
[0004] In this case, the Discrete Cosine Transfomn 
(DCT) is commonly used as the orthogonal transform in 
terms of encoding efficiency and ease of implementa- 
tion. The orthogonal transfomn such as the DCT is car- 
ried out in units of blocks resulting from division of image 
signals into blocks each consisting of a plurality of pix- 
els. The size of the blocks, as well as the property of the 



image signals, largely affects the encoding efficiency. 
[0005] When image signals demonstrate only small 
change in the spatial property, image signals to betrans- 
formed into orthogonal transform coefficients in a nar- 

5 row frequency region are widely distributed on an im- 
age, and the redundancy can be reduced more with in- 
crease in the size of the blocks, i.e., the size of the or- 
thogonal transform, so as to increase the encoding ef- 
ficiency, as compared with cases using smaller blocks, 

10 which raise the need for repeatedly expressing identical 
orthogonal transform coefficients. When image signals 
demonstrate large change in the spatial property on the 
other hand, the increase in the size of blocks results in 
obtaining various frequency components of orthogonal 

'5 transfonn coefficients thereof and thus decreasing the 
deviation of coefficients, which makes efficient entropy 
coding difficult and thus decreases the encoding effi- 
ciency. 

[0006] In order to take advantage of the change of en- 
20 coding efficiency due to the changes in the sizes of the 
blocks for the orthogonal transform and the property of 
image signals, the technology utilized is one of prepar- 
ing orthogonal transform means in a plurality of block 
sizes in advance and adaptively selecting and using a 
25 size achieving the best encoding efficiency out of them. 
This technology is called Adaptive Block size Trans- 
forms (ABT) and is adopted in H.26L. Fig. lA-Fig. 1E 
show orthogonal transfonn blocks used for the ABT in 
H.26L. The ABT permits a size achieving the best en- 
30 coding efficiency to be selected out of four types of or- 
thogonal transform block sizes shown in Figs. 1B-1E, 
for each macroblock of 16x16 pixels shown in Fig. 1A. 
Pixel values of each macroblock are equally divided in 
units of blocks of the selected size and are then subject- 
55 ed to the orthogonal transform. By implementing such 
selection, it becomes feasible to achieve efficient reduc- 
tion of redundancy through the use of the orthogonal 
transform in accordance with the change in the spatial 
property of image signals in the macroblocks. Refer- 
ee ence should be made to H.26L as to more specific de- 
tails of the ABT 

[0007] The entropy coding for the orthogonal trans- 
form coefficients obtained by the orthogonal transform 
is effected on a coefficient string obtained by sequen- 

45 tially reading the orthogonal transfonn coefficients from 
the lowest in the low frequency region. Fig. 2A shows 
an order of reading coefficients in an orthogonal trans- 
form block of 4x4 pixels. Since the coefficients obtained 
by the orthogonal transform are arranged with the low- 

50 est frequency component (i.e. , the dc component) at the 
left upper corner, the coefficients are read out in order 
from the left upper coefficient to obtain a coefficient 
string consisting of sixteen coefficients as shown in Fig. 
2B. This reading order is called zig-zag scan. 

55 [0008] The coefficients obtained by the orthogonal 
transform are noncorrelated with each other, and the 
signal components deviate to the low frequency region. 
For this reason, when they are further quantized, the 
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lower frequency coefficients are more likely to be nonze- 
ro coefficient values, so that many zero-valued coeffi- 
cients appear in the coefficient string. For example, it 
produces a sequence of coefficient values as shown in 
Fig. 2C. Therefore, for efficient entropy coding of the co- 
efficient string of this distribution, it is common practice 
in encoding of images to perform the encoding by ex- 
pressing the coefficient string by the numbers of contin- 
uous zero coefficients preceding a nonzero coefficient 
(runs) and coefficient values (levels) of the nonzero co- 
efficients. Such encoding with runs and levels is also 
used in the entropy coding of orthogonal transfonn co- 
efficients by the ABT. 

[0009] On the other hand, in order to increase the ef- 
ficiency more in the entropy coding as described above, 
H.26L employs the technology called Context-based 
Adaptive Variable Length Code (CAVLC), which is ap- 
plied to the orthogonal transform without the use of the 
ABT, i.e., to cases where the orthogonal transform is al- 
ways carried out in units of orthogonal transform blocks 
of 4x4 pixels. 

[0010] The CAVLC in H.26L utilizes the following fea- 
tures: the maximum number of coefficients in the coef- 
ficient string obtained from each orthogonal transfomn 
block of 4x4 pixels is 16, the magnitude of runs is re- 
stricted by this maximum number, and the magnitude of 
levels tends to be larger at lower frequencies. A number 
of encoding tables used in variable length encoding are 
prepared as optimized tables for respective conditions, 
and they are applied while sequentially being switched, 
so as to increase the encoding efficiency. 
[0011] For example, in the case where runs are en- 
coded in order, the first run can take a variety of values 
from 0 to 14 (according to the definition of runs In H.26L, 
the maximum value of runs is 14, which is two smaller 
than the total number of coefficients). On the other hand, 
a run appearing in the last stage of the sequential en- 
coding of runs can take only one of limited run values, 
because there is the upper limit to the number of coef- 
ficients in the coefficient string. Accordingly, as shown 
in Fig. 3, the right-side encoding table with the largest 
number of elements in the encoding table is applied to 
runs appearing in the initial stage, and the left-side en- 
coding tables with the smaller number of elements in 
each encoding table are applied to runs appearing in the 
last stage. This permits assignment of codes of smaller 
bit counts and thus implements efficient entropy coding. 
The CAVLC achieves the efficient encoding by making 
use of the conditions such as the maximum number of 
coefficients In each block and placing restrictions on the 
range where values to be encoded can take. Reference 
should be made to H.26L as to more specific details of 
the CAVLC. 

SUMMARY OF THE INVENTION 

[0012] By applying the foregoing CAVLC to the ABT, 
it can be expected that more efficient entropy coding will 



also be achieved with the coefficient strings of the ABT. 
[0013] However, the CAVLC achieves the increase of 
encoding efficiency by optimizing the encoding tables in 
variable length coding for the respective conditions, 
5 based on the maximum number of coefficients In blocks, 
and applying the encoding tables to the encoding with 
switching among them. 

[0014] In use of the ABT, the number of coefficients 
in each block differs depending upon blocks of different 
10 sizes; 64 in the case of 8x8 blocks in Fig. 1 B, 32 in the 
cases of 8x4 and 4x8 blocks in Figs. 1C and ID, and 
1 6 in the case of 4x4 blocks in Fig. 1 E. For this reason, 
the application of the CAVLC requires consideration to 
the huge number of conditions that can occur in the re- 
spectlve cases. 

[0015] For example, supposing the encoding tables 
are set according to the maximum number of coeffi- 
cients in coefficient strings, like the encoding tables of 
runs shown in Fig. 3, the huge number of encoding ta- 

20 bles must be prepared; in the case of 8x8 blocks with 
the number of coefficients being 64, it is necessary to 
prepare the encoding tables ranging from the encoding 
table of the number of elements being 2 to the encoding 
table of the number of elements being 62. Likewise, in 

25 the cases of 8x4 and 4x8 blocks with the number of 
coefficients being 32, the encoding tables must be pre- 
pared from that of the number of elements being 2 to 
that of the number of elements being 30. 
[0016] When the entropy coding adapted to the char- 

30 acterlstics of coefficients like the CAVLC was attempted 
to be applied to the orthogonal transforms selectively 
using the orthogonal transfonn blocks of different sizes 
like the ABT as described above, there was the problem 
that the number of encoding tables to be prepared be- 

35 came huge and the memory capacity necessary for re- 
tention of the encoding tables became so large. Since 
it also involved the use of the different encoding tables 
for blocks of respective sizes and the different selection 
procedures thereof, there was the problem that the pro- 

40 cedure In the entropy coding became complicated and 
thus implementing means and instrumental structure 
became complicated. 

[001 7] The present invention has been accomplished 
in order to solve the above problems, and an object of 

45 the invention is to provide an image encoding method, 
an Image decoding method, an Image encoding appa- 
ratus, an image decoding apparatus, an image process- 
ing system, an image encoding program, and an image 
decoding program enabling efficient entropy coding in 

50 the orthogonal transform of variable sizes. 

[0018] In order to achieve the above object, an image 
encoding method (apparatus) according to the present 
invention is an image encoding method (apparatus) of 
dividing image signals into blocks, perfonning an or- 

55 thogonal transform of each block, reading resultant or- 
thogonal transform coefficients to obtain a coefficient 
string, and performing entropy coding thereof, the Image 
encoding method (apparatus) comprising: a block se- 



3 



BNSDOCID: <EP 1 408695A2_I_> 



5 



EP 1 408 695 A2 



6 



lecting step (means) of selecting a size of a block for the 
orthogonal transform, out of a plurality of blocks of dif- 
ferent sizes; a coefficient string dividing step (means) 
of, when a block of a size larger than a minimum size is 
selected In the block selecting step (means), dividing a 
coefficient string in the block into a plurality of coefficient 
strings of a length equal to that of a coefficient string in 
a block of the minimum size; and an encoding step 
(means) of performing entropy coding adapted to the co- 
efficient string In the block of the minimum size. An im- 
age encoding program according to the present inven- 
tion is configured to let a computer execute each of the 
above steps. 

[001 9] I n the image encoding method according to the 
present Invention, as described above, when a block of 
a large size is selected to be subjected to the orthogonal 
transform, the coefficient string in that block Is first di- 
vided Into coefficient strings and then the entropy coding 
Is carried out for each of them. This permits the entropy 
coding adapted to the coefficient string In the block of 
the minimum size to be applied to the entropy coding of 
the coefficient string in the selected block, whereby it is 
feasible to implement efficient entropy coding of orthog- 
onal transform coefficients, without complicating the 
procedure of entropy coding. 

[0020] In the above Image encoding method (appara- 
tus), the coefficient string dividing step (means) may be 
configured to read coefficients of the coefficient string 
from the lowest In a low frequency region and assign the 
read coefficients one by one in order to the plurality of 
coefficient strings of the length equal to that of the co- 
efficient string in the block of the minimum size, thereby 
obtaining the divided coefficient strings. In the above im- 
age encoding program, the coefficient string dividing 
step executed by the computer may also be configured 
to read coefficients of the coefficient string from the low- 
est in a low frequency region and assign the read coef- 
ficients one by one in order to the plurality of coefficient 
strings of the length equal to that of the coefficient string 
In the block of the minimum size, thereby obtaining the 
divided coefficient strings. 

[0021 ] I n the above image encoding method (appara- 
tus), the coefficient string dividing step (means) may be 
configured to read coefficients of the coefficient string 
from the lowest In a low frequency region and repeatedly 
perform reading of coefficients by the number equal to 
the number of coefficients in the coefficient string in the 
block of the minimum size to obtain a divided coefficient 
string, thereby obtaining the divided coefficient strings. 
In the above Image encoding program, the coefficient 
string dividing step executed by the computer may also 
be configured to read coefficients of the coefficient string 
from the lowest In a low frequency region and repeatedly 
perform reading of coefficients by the number equal to 
the number of coefficients in the coefficient string In the 
block of the minimum size to obtain a divided coefficient 
string, thereby obtaining the divided coefficient strings. 
[0022] An image decoding method (apparatus) ac- 



cording to the present Invention Is an image decoding 
method (apparatus) of decoding encoded data encoded 
by an Image encoding method of dividing image signals 
into blocks, performing an orthogonal transform of each 
5 block, reading resultant orthogonal transform coeffi- 
cients to obtain a coefficient string, and performing en- 
tropy coding thereof, the Image decoding method (ap- 
paratus) comprising: a block selecting step (means) of 
selecting a size of a block for the orthogonal transform, 
10 out of a plurality of blocks of different sizes; a decoding 
step (means) for performing decoding of the encoded 
data by entropy coding adapted to a coefficient string In 
a block of a minimum size out of the plurality of blocks; 
and a coefficient string constructing step (means) of, 
15 when a block of a size larger than the minimum size is 
selected in the block selecting step (means), construct- 
ing a coefficient string of the block of the larger size from 
a plurality of coefficient strings decoded In the decoding 
step (means). An image decoding program according to 
the present Invention is configured to let a computer ex- 
ecute each of the above steps. 

[0023] In the image decoding method according to the 
present Invention, as described above, when a block of 
a larger size is selected to Implement decoding of the 
encoded data subjected to the orthogonal transform, the 
coefficient string In that block Is constructed from coef- 
ficient strings of blocks included in that block. This per- 
mits a coefficient string to be decoded from the encoded 
data by the entropy coding adapted to the coefficient 
string in the block of the minimum size, whereby it is 
feasible to implement efficient entropy coding of orthog- 
onal transform coefficients, without complicating the 
procedure of decoding of entropy coding, 
[0024] In the above Image decoding method (appara- 
tus), the coefficient string constructing step (means) 
may be configured to read coefficients In the plurality of 
coefficient strings decoded in the decoding step 
(means), from the lowest in a low frequency region and 
write the coefficients read out of the respective coeffi- 
cient strings, one by one in order into a new coefficient 
string from the low frequency region, thereby obtaining 
the constructed coefficient string. In the above decoding 
program, the coefficient string constructing step execut- 
ed by the computer may also be configured to read co- 
efficients in the plurality of coefficient strings decoded 
In the decoding step, from the lowest in a low frequency 
region and write the coefficients read out of the respec- 
tive coefficient strings, one by one in order into a new 
coefficient string from the low frequency region, thereby 
obtaining the constructed coefficient string. 
[0025] In the above image decoding method (appara- 
tus), the coefficient string constructing step (means) 
may be configured to read coefficients in the plurality of 
coefficient strings decoded in the decoding step 
(means), from the lowest in a low frequency region and 
write the read coefficients in units of the original coeffi- 
cient strings into a new coefficient string from the low 
frequency region, thereby obtaining the constructed co- 
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efficient string. In the above innage decoding progrann, 
the coefficient string constructing step executed by the 
computer may also be configured to read coefficients in 
the plurality of coefficient strings decoded in the decod- 
ing step, from the lowest in a low frequency region and 
write the read coefficients in units of the original coeffi- 
cient strings into a new coefficient string from the low 
frequency region, thereby obtaining the constructed co- 
efficient string. 

[0026] An Image processing system according to the 
present invention comprises the above Image encoding 
apparatus and the above image decoding apparatus. 
[0027] The image processing system enables effi- 
cient entropy coding in the orthogonal transform of var- 
iable sizes because of the provision of the above image 
encoding apparatus and also enables decoding of 
codes entropy-encoded by the above image encoding 
apparatus, because of the provision of the above image 
decoding apparatus. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0028] Fig. 1A to Fig. 1E are diagrams showing the 
orthogonal transform blocks used in the Adaptive Block 
size Transfomis (ABT) of H.26L. 

[0029] Fig. 2A to Fig. 2C are diagrams showing a re- 
adout method of reading coefficients in a4x4 block, and 
an example of a coefficient string after readout. 
[0030] Fig. 3 is a diagram showing the encoding ta- 
bles of runs used in the Context-based Adaptive Varia- 
ble Length Code (CAVLC) of H.26L. 
[0031] Fig. 4Ato Fig. 4D are diagrams showing an ex- 
ample in which a method of readout and division of or- 
thogonal transform coefficients according to the present 
invention is carried out for an 8x8 block. 
[0032] Fig. 5A to Fig. 5C are diagrams showing defi- 
nitions of arrangement in original blocks, of coefficient 
strings after division according to the present invention. 
[0033] Fig. 6A to Fig. 6D are diagrams showing an ex- 
ample in which another method of readout and division 
of orthogonal transform coefficients according to the 
present invention is carried out for an 8x8 block. 
[0034] Fig. 7 is a block diagram showing a configura- 
tion of an image processing system according to an em- 
bodiment 

DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[0035] The preferred embodiments of the Image en- 
coding method, Image decoding method, image encod- 
ing apparatus, image decoding apparatus, and image 
processing system according to the present invention 
will be described below In detail with reference to the 
drawings. The same elements will be denoted by the 
same reference symbols throughout the description of 
the drawings, without redundant description thereof. 
[0036] The description will be based on the premise 



that the encoding and decoding in the description here- 
inafter are implemented on the basis of H.26L, and the 
part without specific description about the operation in 
the image encoding is supposed to conform to the op- 
5 eration In H.26L. It Is, however, noted that the present 
invention is not limited to H.26L. 

[0037] An embodiment of the present invention will be 
described. In the encoding according to the present em- 
bodiment, concerning the orthogonal transform coeffi- 

10 cients in blocks of the respective sizes in the ABT of H. 
26L, a coefficient string obtained from each block is di- 
vided into a plurality of coefficient strings each consist- 
ing of coefficients in the number equal to the number of 
coefficients in a coefficient string of a 4x4 block. This 

IS makes it feasible to perform the entropy coding by the 
CAVLC of H.26L defined so as to be adapted to the 4x4 
blocks. 

[0038] It is assumed that in the encoding, first, the 
ABT in H.26L is applied to one macroblock, a size 
20 achieving the best encoding efficiency is selected out of 

the blocks shown in Figs. 1B-1E, and the orthogonal 
transform is effected in units of the blocks of the selected 
size. 

[0039] It is also assumed that the CAVLC in H.26L is 
25 employed as the entropy coding of orthogonal transform 

coefficients. Namely, it is assumedthat only the variable 
length encoding adapted to the encoding of orthogonal 
transform coefficients for the 4x4 block shown in Fig. 
1 E is defined. 

30 [0040] For example, let us suppose herein that the 
8x8 block in Fig. 1B Is selected. The following readout 
operation of reading the orthogonal transform coeffi- 
cients is carried out for this 8x8 block. First, sixty four 
coefficients in the 8x8 block are read out by zig-zag 

35 scan as shown in Fig. 4A, to obtain a coefficient string 
as shown in Fig. 4B. 

[0041] Then this coefficient string is divided into four 
coefficient strings each consisting of sixteen coeffi- 
cients, the number of which is the same as the number 

40 of coefficients in the coefficient string of the 4x4 block. 
Here the coefficients in the original coefficient string are 
read out from the lowest in the low frequency region and 
alternately assigned to the four coefficient strings, there- 
by obtaining the coefficient strings after division . Fig. 4C 

45 and Fig. 4D show this readout operation. Since the co- 
efficients are alternately assigned to the respective co- 
efficient strings from the lowest in the low frequency re- 
gion, the first divided coefficient string is assigned the 
coefficients read out in the order of the zeroth, fourth, 

50 eighth, twelfth, ... in the original coefficient string, and 
the second divided coefficient string is assigned the co- 
efficients read out in the order of the first, fifth, ninth, 
thirteenth,... in the original coefficient string. The third 
and fourth divided coefficient strings are not illustrated 

55 in Figs. 4A-4D. 

[0042] Similarly, when the 8x4 block or 4x8 block of 
Fig. 1 C or Fig. 1 D is selected, thirty two coefficients are 
divided into two coefficient strings each consisting of six- 
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teen coefficients. The readout method for obtaining the 
divided coefficient strings is also similar to that in the 
case of the 8x8 block except that the number of coeffi- 
cient strings alternately assigned the coefficients is 2, 
instead of 4; the coefficients in the original coefficient 
string are read out from the lowest in the low frequency 
region and alternately assigned to the two coefficient 
strings. 

[0043] The coefficient strings obtained in this way are 
entropy encoded according to the same procedure as 
the encoding of CAVLC without the use of the ABT, and 
the encoded data is outputted in order as encoded data 
of orthogonal transform coefficients in the ABT block. 
[0044] At this time, the CAVLC of H.26L utilizes the 
space context to switch the applied encoding table on 
the basis of the number of nonzero coefficients in an 
adjacent 4x4 block. For this reason, arrangements of 
coefficient strings after division in the ABT blocks are 
defined for the ABT blocks larger than the 4x4 block. 
The definitions are presented in Fig. 5A to Fig. 6C. For 
example, the 8x8 block shown in Fig. 5A is handled on 
the assumption that the first divided coefficient string il- 
lustrated in Fig. 4C is located at the position of "1" and 
the second divided coefficient string illustrated in Fig. 
4D at the position of "2." It is assumed that, using the 
definitions of the arrangement, the space contextforthe 
divided coefficient strings in the ABT blocks, or the 
space context for 4 x 4 blocks adjacent to the ABT blocks 
is handled in the same manner without any change as 
in the technique in the CAVLC of H.26L. 
[0045] In the decoding, the original orthogonal trans- 
form matrix can be obtained according to the procedure 
reverse to the procedure in the encoding. 
[0046] Let us suppose that the ABT in H.26L is applied 
to one macroblock, a size is designated out of the blocks 
shown in Figs. IB to 1E, and encoded data from this 
macroblock is one resulting from the orthogonal trans- 
form carried out in units of ABT blocks of the size. 
[0047] At this time the encoded data contains encod- 
ed data obtained by entropy coding of the divided coef- 
ficient strings by the CAVLC, in order as encoded data 
of orthogonal transform coefficients in the ABT blocks. 
Accordingly, it is sequentially decoded according to the 
procedure of CAVLC to obtain the coefficient strings af- 
ter the division. 

[0048] Since these divided coefficient strings are co- 
efficient strings divided by the readout method shown in 
Figs. 4A-4D, the original orthogonal transform coeffi- 
cient block can be obtained by conversely writing the 
coefficients of the divided coefficient strings into each 
original coefficient string and further writing the resultant 
coefficient strings into the orthogonal transform coeffi- 
cient block. The procedure thereafter is the same as the 
decoding procedure with application of the ABT in H. 
26L. 

[0049] A configuration of image processing system 1 
for implementing the above image encoding and image 
decoding will be described below. Fig. 7 is a block dia- 



gram showing image processing system 1 according to 
an embodiment. The image processing system 1 is 
composed of image encoding apparatus 10 for encod- 
ing image data, and image decoding apparatus 20. 

5 [0050] The image encoding apparatus 1 0 has orthog- 
onal transfomn unit 11 , coefficient string divider 12, en- 
tropy encoder 1 3, and block selector 1 4. The orthogonal 
transform unit 11 has a function of performing the or- 
thogonal transform of image data to transform it into fre- 

10 quency components. The orthogonal transform unit 11 
divides each macroblock of the image data into a plu- 
rality of blocks and performs the orthogonal transform 
of the divided blocks. It is connected to block selector 
14, and the block selector 1 4 selects a block capable of 

15 implementing the orthogonal transfomn with the best ef- 
ficiency. 

[0051] The coefficient string divider 12 has a function 
of dividing a coefficient string obtained by the orthogonal 
transform, into coefficient strings of a predetermined 

20 length. Here the term "predetermined length" is defined 
as a length of a coefficient string obtained by the orthog- 
onal transform of a block of a minimum size out of the 
blocks into which a macroblock can be divided for the 
orthogonal transform of image data by orthogonal trans- 

25 form unit 11. 

[0052] The entropy encoder 13 has a function of en- 
coding the coefficient strings divided by the coefficient 
string divider 12. Since the coefficient string divider 12 
divides the original coefficient string into the coefficient 

30 strings of the same length as that of the coefficient string 
of the minimum block as described above, the entropy 
encoder 1 3 can be configured to be adapted for encod- 
ing of the coefficient strings of that length and can per- 
form efficient encoding. 

35 [0053] The image decoding apparatus 20 has entropy 
decoder 23, coefficient string constructor 22, inverse or- 
thogonal transform unit 21 , and block selector 24. The 
entropy decoder 23 has a function of decoding encoded 
data. 

40 [0054] The coefficient string constructor 22 has a 
function of constructing an original coefficient string 
from coefficient strings divided upon encoding by image 
encoding apparatus 1 0. The coefficient string construc- 
tor 22 is connected to block selector 24, acquires infor- 

45 nnation about the size of the original block from the block 
selector 24, and constructs the original coefficient string 
on the basis of the information. The block selector 24 is 
able to acquire the size of the original block, based on 
additional information or the like transmitted with the en- 

50 coded data from the image encoding apparatus. 

[0055] The inverse orthogonal transform unit 21 has 
a function of transforming the coefficient strings con- 
structed by the coefficient string constructor 22, into im- 
age data. 

55 [0056] The image processing system 1 of the struc- 
ture as described above implements the aforemen- 
tioned image encoding and image decoding. The afore- 
mentioned image encoding method and image decod- 
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ing method can be substantialized by an image encod- 
ing program and an image decoding program for letting 
a computer execute each of the steps thereof. 
[0057] In the present embodiment the zig-zag scan 
was applied to readout of orthogonal transform coeffi- 5 
cients, but the readout method of coefficients in appli- 
cation of the present invention does not have to be lim- 
ited to the zig-zag scan. For example, the present in- 
vention may also be applied to cases of application of 
the field scan for field encoding In interlaced Images, io 
which is defined in the ABT of H.26L. In this application, 
the dividing technique of the coefficient strings in the 
present embodiment can also be applied as it is. 
[0058] The present embodiment showed the alternate 
readout method as shown in Figs. 4A-4D, as a readout is 
method for obtaining the coefficient strings after the di- 
vision, but It Is also possible to obtain the coefficient 
strings after the division by another readout method dif- 
ferent therefrom. For example, as shown In Figs. 6C and 
6D, sixteen consecutive coefficients each are read out 
from the original coefficient string from the lowest in the 
low frequency region and each series is assigned to one 
of the coefficient strings after the division. 
[0059] In the present embodiment, the readout of or- 
thogonal transform coefficients in the encoding is imple- 25 
mented so as to first perform the first readout for obtain- 
ing the coefficient string from the orthogonal transform 
block and then perform the second readout for obtaining 
a plurality of coefficient strings after the division. The 
writing of orthogonal transform coefficients In the decod- 30 
ing is implemented so as to first perform the first writing 
for obtaining the coefficient string after construction and 
then perform the second writing for obtaining the orthog- 
onal transform block. However, the readout and writing 
of coefficients according to the present invention do not 35 
have to be limited to these methods, but may also be 
implemented by a variety of readout and writing meth- 
ods that can obtain coefficient strings in the desired ar- 
rangement. For example, it is also possible to implement 
such readout as to immediately obtain a plurality of di- 40 
vided coefficient strings in the first coefficient readout 
from the orthogonal transform block. The writing from 
the divided coefficient strings may also be modified so 
as to immediately obtain the orthogonal transform block 
In the first coefficient writing. 45 
[0060] In the present embodiment, the coefficient 
strings after the division were arranged as shown in 
Figs. 5A-5C, and the space context from the adjacent 
4x4 block in the CAVLC in H.26L was assumed to be 
handled without any change. In this regard, it can also 50 
be contemplated that the coefficient strings divided from 
the coefficient strings of the ABT blocks larger than the 
4x4 block are originally different In the property from 
the coefficient strings in the case of the 4x4 block and 
weights are given to numerals used as the space con- 55 
text. Specifically, where the number of nonzero coeffi- 
cients is used as the space context from the adjacent 
block, a constant Is always added to or multiplied by the 



number of nonzero coefficients In each divided coeffi- 
cient string obtained from an ABT block larger than the 
4x4 block, when used as the space context. In another 
configuration, where the coefficient strings after the di- 
vision are obtained by continuously reading out the co- 
efficients from the lowest in the low frequency region as 
shown in Figs. 6A-6D, different constants may be added 
to or multiplied by coefficients read out from the low fre- 
quency region and coefficients read out from the high 
frequency region. 

[0061] The embodiments were described on the 
premise that the encoding and decoding were substan- 
tialized on the basis of H.26L and were described based 
on the ABT and CAVLC in H.26L. However, It is noted 
that the Image encoding methods to which the present 
invention can be applied are not limited to H.26L, and 
the present invention can be applied to various image 
encoding methods permitting selection among a plural- 
ity of sizes of blocks for the orthogonal transform and 
using the entropy coding adapted to the orthogonal 
transform coefficients. 

[0062] The image encoding method, image decoding 
method, Image encoding apparatus, Image decoding 
apparatus, and image processing system according to 
the present Invention provide the following effect, as de- 
tailed above. Namely, where a size of a block for the 
orthogonal transform can be selected from a plurality of 
sizes, a coefficient string consisting of resultant orthog- 
onal transform coefficients Is divided into a plurality of 
coefficient strings of the same size as that of the coeffi- 
cient string In the block of the minimum size and each 
of these coefficient strings is subjected to the entropy 
coding adapted to the coefficient string In the block of 
the minimum size; whereby It Is feasible to Implement 
the efficient entropy coding, without Increase in the 
number of encoding tables in the entropy coding and 
without complicating the encoding tables and the pro- 
cedure of selection thereof. 



Claims 

1. An image encoding method of dividing Image sig- 
nals into blocks, performing an orthogonal trans- 
form of each block, reading resultant orthogonal 
transfomn coefficients to obtain a coefficient string, 
and performing entropy coding thereof, the image 
encoding method comprising: 

a block selecting step of selecting a size of a 
block for the orthogonal transform, out of a plu- 
rality of blocks of different sizes; 
a coefficient string dividing step of, when a 
block of a size larger than a minimum size is 
selected in the block selecting step, dividing a 
coefficient string in said block into a plurality of 
coefficient strings of a length equal to that of a 
coefficient string In a block of the minimum size; 
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and 

an encoding step of performing entropy coding 
adapted to the coefficient string in the blocl< of 

the minimum size. 

5 

2. An image decoding method of decoding encoded 
data encoded by an image encoding method of di- 
viding image signals into blocks, performing an or- 
thogonal transform of each block, reading resultant 
orthogonal transform coefficients to obtain a coeffi- io 
cient string, and performing entropy coding thereof, 

the Image decoding method comprising: 

a block selecting step of selecting a size of a 
block for the orthogonal transform, out of aplu- 
rality of blocks of different sizes; 
a decoding step for performing decoding of the 
encoded data by entropy coding adapted to a 
coefficient string in a block of a minimum size 
out of the plurality of blocks; and 20 
a coefficient string constructing step of, when a 
block of a size larger than the minimum size is 
selected in the block selecting step, construct- 
ing a coefficient string of the block of the larger 
size from a plurality of coefficient strings decod- 25 
ed In the decoding step. 

3. An image encoding apparatus of dividing image sig- 
nals into blocks, performing an orthogonal trans- 
form of each block, reading resultant orthogonal so 
transform coefficients to obtain a coefficient string, 
and performing entropy coding thereof, the image 
encoding apparatus comprising: 

block selecting means for selecting a size of a 35 
block for the orthogonal transform, out of a plu- 
rality of blocks of different sizes; 
coefficient string dividing means for, when a 
block of a size larger than a minimum size is 
selected by the block selecting means, dividing 40 
a coefficient string in said block into a plurality 
of coefficient strings of a length equal to that of 
a coefficient string in a block of the minimum 
size; and 

encoding means for performing entropy coding 
adapted to the coefficient string in the block of 
the minimum size. 

4. The image encoding apparatus according to Claim 

3, wherein the coefficient string dividing means is 50 
configured to read coefficients of the coefficient 
string from the lowest in a low frequency region and 
assign the read coefficients one by one in order to 
the plurality of coefficient strings of the length equal 
to that of the coefficient string in the block of the ss 
minimum size, thereby obtaining the divided coeffi- 
cient strings. 



5. The image encoding apparatus according to Claim 
3, wherein the coefficient string dividing means is 
configured to read coefficients of the coefficient 
string from the lowest in a low frequency region and 
repeatedly perform reading of coefficients by the 
number equal to the number of coefficients in the 
coefficient string in the block of the minimum size 
to obtain a divided coefficient string, thereby obtain- 
ing the divided coefficient strings. 

6. An image decoding apparatus of decoding encoded 
data encoded by an image encoding method of di- 
viding image signals into blocks, performing an or- 
thogonal transform of each block, reading resultant 
orthogonal transform coefficients to obtain a coeffi- 
cient string, and performing entropy coding thereof, 
the image decoding apparatus comprising: 

block selecting means for selecting a size of a 
block for the orthogonal transfonn, out of a plu- 
rality of blocks of different sizes; 
decoding means for performing decoding of the 
encoded data by entropy coding adapted to a 
coefficient string in a block of a minimum size 
out of the plurality of blocks; and 
coefficient string constructing means for, when 
a block of a size larger than the minimum size 
Is selected by the block selecting means, con- 
structing a coefficient string of the block of the 
larger size from a plurality of coefficient strings 
decoded by the decoding means. 

7. The image decoding apparatus according to Claim 
6, wherein the coefficient string constructing means 
is configured to read coefficients in the plurality of 
coefficient strings decoded by the decoding means, 
from the lowest in a low frequency region and write 
the coefficients read out of the respective coefficient 
strings, one by one in order into a new coefficient 
string from the low frequency region, thereby ob- 
taining the constructed coefficient string. 

8. The Image decoding apparatus according to Claim 
6, wherein the coefficient string constructing means 
is configured to read coefficients in the plurality of 
coefficient strings decoded by the decoding means, 
from the lowest In a low frequency region and write 
the read coefficients in units of the original coeffi- 
cient strings into a new coefficient string from the 
low frequency region, thereby obtaining the con- 
structed coefficient string. 

9. An Image encoding program for dividing Image sig- 
nals into blocks, performing an orthogonal trans- 
form of each block, reading resultant orthogonal 
transfonn coefficients to obtain a coefficient string, 
and performing entropy coding thereof, the image 
encoding program letting a computer execute: 
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a block selecting step of selecting a size of a 
block for the orthogonal transform, out of a plu- 
rality of blocks of different sizes; 
a coefficient string dividing step of, when a 
block of a size larger than a nninimum size is 5 
selected in the block selecting step, dividing a 
coefficient string in said block into a plurality of 
coefficient strings of a length equal to that of a 
coefficient string in a block of the minimum size; 
and 10 
an encoding step of performing entropy coding 
adapted to the coefficient string in the block of 
the minimum size. 

10. An image decoding program for decoding encoded is 

data encoded by an image encoding method of di- 
viding image signals into blocks, performing an or- 
thogonal transfonn of each block, reading resultant 
orthogonal transform coefficients to obtain a coeffi- 
cient string, and performing entropy coding thereof, 20 
the image decoding program letting a computer ex- 
ecute: 

a block selecting step of selecting a size of a 
block for the orthogonal transform, out of a plu- 25 
rality of blocks of different sizes; 
a decoding step for performing decoding of the 
encoded data by entropy coding adapted to a 
coefficient string in a block of a minimum size 
out of the plurality of blocks; and 30 
a coefficient string constructing step of, when a 
block of a size larger than the minimum size is 
selected in the block selecting step, construct- 
ing a coefficient string of the block of the larger 
size from a plurality of coefficient strings decod- 35 
ed in the decoding step. 
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Fig. 5 A 
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DEFINITION OF ARRANGEMENT OF 
DIVIDED COEFFICIENT STRINGS IN 8 x 8 BLOCK 



Fig.SB 




DEFINITION OF ARRANGEMENT OF 
DIVIDED COEFFICIENT STRINGS IN 8x4 BLOCK 



Fig.SC 




DEFINITION OF ARRANGEMENT OF 
DIVIDED COEFFICIENT STRINGS IN 4x8 BLOCK 
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(54) Image encoding and decoding method 



(57) Image encoding apparatus 1 0 according to the 
present invention is an image encoding apparatus 10 
for dividing image signals into blocks, performing an or- 
thogonal transform of each block, reading resultant or- 
thogonal transfomri coefficients to obtain a coefficient 
string, and performing entropy coding, which has block 
selector 1 4 for selecting a size of a block for the orthog- 
onal transform, out of a plurality of blocks of different 
sizes; coefficient string divider 12 for, when a block of a 



size larger than a minimum size is selected by block se- 
lector 14, dividing a coefficient string in the block into a 
plurality of coefficient strings of a length equal to that of 
a coefficient string in a block of the minimum size; and 
encoder 1 3 for performing entropy coding adapted to the 
coefficient string in the block of the minimum size. This 
substantializes the image encoding apparatus capable 
of achieving efficient entropy coding in the orthogonal 
transform of variable sizes. 
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